In sequence transduction, “autoregression” (or “auto-regression”) refers to the prediction of elements in a sequence based on the elements of the sequence that came before it. A model that exhibits this behavior is said to have the “autoregressive property.”
Auto-regression is a key aspect of language models.